Content presenting method, user equipment and system

ABSTRACT

A content presenting method includes starting, by user equipment, a 3D application, in response to an instruction for starting the 3D application, the 3D application presenting a simulated object and a virtual screen for the simulated object to watch video content, and receiving, by the user equipment, a content source address from a 3D application server, the content source address being of live content that is currently broadcasted on the 3D application server. The method further includes obtaining, by the user equipment, audio data and video data from a content providing server, based on the content source address, rendering, by the user equipment, the audio data and the video data to obtain the video content and audio content, playing, by the user equipment, the audio content in the 3D application, and displaying, by the user equipment, the video content, using the virtual screen.

RELATED APPLICATION

This application is a U.S. national stage application under 35 U.S.C. §371 of International Patent Application No. PCT/CN2017/075437 filed onMay 24, 2016, which claims priority from Chinese Patent Application No.201610120288.5, filed in the Chinese Patent Office on Mar. 3, 2016, andentitled “CONTENT PRESENTING METHOD, USER EQUIPMENT, AND SYSTEM,” whichare incorporated herein by reference in their entireties.

BACKGROUND 1. Field

Methods and apparatuses consistent with example embodiments relate tothree-dimensional (3D) technologies, and in particular, to a contentpresenting method, user equipment, and a system.

2. Description of Related Art

Interactive applications related to 3D scenarios have been developed. A3D application system includes user equipment and a 3D applicationserver, and the user equipment may obtain data of an interactiveapplication from the 3D application server and display the interactiveapplication.

Video switching may need to be performed to display another applicationor video when user equipment displays a 3D interactive application, andconsequently, operations may be very complex. In addition, someinteractive applications have built-in browsers. The browser may providea small window in a corner for a user when the user starts a 3Dinteractive application, so that the user may view other content on thesmall window while viewing the 3D interactive application. However, sucha presenting manner is only a planarized presentation on the smallwindow, and may have a very poor visual effect.

SUMMARY

According to example embodiments, there is provided a content presentingmethod of a three-dimensional (3D) application system, the 3Dapplication system including user equipment, a 3D application server,and a content providing server, and the method including starting, bythe user equipment, a 3D application, in response to an instruction forstarting the 3D application, the 3D application presenting a simulatedobject and a virtual screen for the simulated object to watch videocontent, and receiving, by the user equipment, a content source addressfrom the 3D application server, the content source address being of livecontent that is currently broadcasted on the 3D application server. Themethod further includes obtaining, by the user equipment, audio data andvideo data from the content providing server, based on the contentsource address, rendering, by the user equipment, the audio data and thevideo data to obtain the video content and audio content, playing, bythe user equipment, the audio content in the 3D application, anddisplaying, by the user equipment, the video content, using the virtualscreen.

According to example embodiments, there is provided user equipment of athree-dimensional (3D) application system, the 3D application systemfurther including a 3D application server and a content providingserver, and the user equipment including: at least one memory configuredto store computer program code; and at least one processor configured toaccess the at least one memory and operate according to the computerprogram code. The computer program code includes response codeconfigured to cause the at least one processor to start a 3Dapplication, in response to an instruction for starting the 3Dapplication, the 3D application presenting a simulated object and avirtual screen for the simulated object to watch video content,receiving code configured to cause the at least one processor to receivea content source address from the 3D application server, the contentsource address being of live content that is currently broadcasted onthe 3D application server, and obtaining code configured to cause the atleast one processor to obtain audio data and video data from the contentproviding server, based on the content source address. The computerprogram code further includes rendering code configured to cause the atleast one processor to render the audio data and the video data toobtain the video content and audio content, playing code configured tocause the at least one processor to play the audio content in the 3Dapplication, and displaying code configured to cause the at least oneprocessor to display the video content, using the virtual screen.

According to example embodiments, there is provided a non-transitorycomputer-readable storage medium storing instructions that cause aprocessor of user equipment to start a 3D application, in response to aninstruction for starting the 3D application, the 3D applicationpresenting a simulated object and a virtual screen for the simulatedobject to watch video content, receive a content source address from a3D application server, the content source address being of live contentthat is currently broadcasted on the 3D application server, and obtainaudio data and video data from a content providing server, based on thecontent source address. The instructions further cause the processor torender the audio data and the video data to obtain the video content andaudio content, play the audio content in the 3D application, and displaythe video content, using the virtual screen.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of an example of a 3D application scenarioaccording to example embodiments.

FIG. 2 is a schematic diagram of 3D application system according toexample embodiments.

FIG. 3A is a schematic diagram of a content presenting method accordingto example embodiments.

FIG. 3B is a schematic diagram of an example of a content presentingmethod according to example embodiments.

FIG. 4 is a schematic diagram of another example of a 3D applicationsystem according to example embodiments.

FIG. 5 is a schematic diagram of another example embodiment of a contentpresenting method according to example embodiments.

FIG. 6 is a schematic diagram of cross-process image rendering accordingto example embodiments.

FIG. 7 is a schematic diagram of dirty region update according toexample embodiments.

FIG. 8 is a schematic diagram of an example of a web page according toexample embodiments.

FIG. 9 is a schematic diagram of an example of a web page with an addedvirtual screen according to example embodiments.

FIG. 10 is a schematic diagram of an example of a web page with an addedvirtual screen after inverse gamma correction according to exampleembodiments.

FIG. 11 is a schematic diagram cross-process audio rendering accordingto example embodiments.

FIG. 12 is a schematic diagram of user equipment according to exampleembodiments.

FIG. 13 is a schematic diagram of another example of user equipmentaccording to example embodiments.

FIG. 14 is a schematic diagram of another example of user equipmentaccording to example embodiments.

FIG. 15 is a schematic structural diagram of user equipment according toexample embodiments.

DESCRIPTION OF EXAMPLE EMBODIMENTS

Example embodiments of this application provide a content presentingmethod, so that video content can be intuitively presented in a 3Dapplication without additionally opening a small window by a user,improving video content presentation quality, and also improvingefficiency of communication between the user and an interactiveapplication and the video content. The example embodiments of thisapplication further provide corresponding user equipment and acorresponding system. Detailed descriptions are separately providedbelow.

The following clearly and completely describes the technical solutionsin the example embodiments of this application with reference to theaccompanying drawings in the example embodiments of this application.Apparently, the described example embodiments are some exampleembodiments of this application rather than all of the exampleembodiments. All other example embodiments obtained by a person skilledin the art based on the example embodiments of this application withoutcreative efforts shall fall within the protection scope of thisapplication.

For ease of understanding, the following first briefly describes termsin this application.

A 3D application system in the example embodiments of this applicationmay be understood as a 3D game system.

A 3D game is a stereoscopic video game manufactured based on 3D computergraphics, including, but not limited to: an online 3D game in whichmulti-players are online, a single player 3D game in which a singleplayer plays a game, and a virtual reality game system established basedon a 3D game system. The 3D game is suitable for use in platforms, suchas a video game console, a mobile phone game platform, and a personalcomputer game platform, 3D games on which are all included.

A virtual community is a virtual community environment of a 3D game, andis a game environment manufactured based on 3D computer graphics. Thevirtual community may include a simulated object corresponding to aplayer in the game. The virtual community in this application includes avirtual screen, and the virtual screen may be similar to a large virtualscreen projected in the external field.

A game anchor is a person that reports and narrates a game on electronicmedia such as the Internet.

A live game broadcast means broadcasting while playing a game by usingan Internet technology.

Using League of Legends (LOL) as an example, a browser is usually builtin a game client, and the browser enables a player in the game client towatch a real-time live video and perform simple interaction. However,the concept of virtual community is not included in this product andgame players cannot directly perceive the existence of each other. Thissolution is much more similar to watching a competition in front of atelevision, but the solutions provided in this application are mainly tocreate an atmosphere of watching a competition on live.

The example embodiments of this application describe a solution ofcombining a 3D simulated virtual community with a live video on theInternet, and the solution provided in the example embodiments of thisapplication enables a player to watch, in the simulated virtualcommunity, a live video on the Internet.

A live video on a virtual screen of the virtual community may be a videobroadcasted by a game anchor, or may be another live game video. For anexample of the virtual community or a 3D application scenario in theexample embodiments of this application, refer to FIG. 1 forunderstanding.

FIG. 2 is a schematic diagram of a 3D application system according toexample embodiments.

As shown in FIG. 2, the 3D application system includes a 3D applicationserver, a content providing server, and a plurality of user equipments.Each user equipment may correspond to one player, and each userequipment has installed a client of a 3D application.

The player clicks, on the user equipment, the client of the 3Dapplication, and the user equipment starts the 3D application inresponse to an instruction for starting the 3D application. The 3Dapplication includes a simulated object and a virtual screen forwatching video content by the simulated object, and the simulated objectin the 3D application may be a virtual identity of the player in the 3Dapplication.

In a procedure of starting the 3D application, the 3D applicationrequests, from the 3D application server, an address of live contentthat is currently broadcasted on the virtual screen, that is, a contentsource address in these example embodiments of this application. The 3Dapplication server sends the content source address to the userequipment after determining the content source address according to thelive content that is currently broadcasted.

The user equipment obtains audio and video data from the contentproviding server according to the content source address after receivingthe content source address, and the audio and video data is audio andvideo data of the live content.

The user equipment renders the audio and video data after obtaining theaudio and video data of the live content, to obtain corresponding audiocontent and video content, and plays the audio content in the 3Dapplication and displays the video content by using the virtual screen.

FIG. 3A is a schematic diagram of a content presenting method accordingexample embodiments.

For a method for presenting a live video in a 3D application, refer to aprocedure of FIG. 3 for understanding.

101. User equipment starts a 3D application in response to aninstruction for starting the 3D application.

The 3D application includes a simulated object and a virtual screen forwatching video content by the simulated object.

102. The user equipment receives a content source address sent by the 3Dapplication server, and sends the content source address to a contentproviding server.

The content source address is an address of live content that iscurrently broadcasted on the 3D application server.

103. The user equipment obtains audio and video data from the contentproviding server according to the content source address.

The audio and video data is audio and video data of a game that iscurrently played on a game server or of other video content.

104. The user equipment renders the audio and video data to obtain videocontent and audio content.

105. The user equipment plays the audio content in the 3D application,and displays the video content by using the virtual screen.

A small window may need to be used to display other video content when a3D application is displayed. By comparison, according to the contentpresenting method provided in the example embodiments of thisapplication, video content can be presented on a virtual screen of a 3Dapplication without additionally opening a small window by a user,improving video content presentation quality, and also improvingefficiency of communication between the user and an interactiveapplication and the video content.

Optionally, the audio and video data includes audio data and video data,and the rendering the audio and video data to obtain video content andaudio content includes:

rendering, by the user equipment, the audio data by using a web pageprocess to obtain the audio content, and rendering the video data byusing the web page process to obtain the video content; and

the playing, by the user equipment, the audio content in the 3Dapplication, and displaying the video content by using the virtualscreen includes:

playing, by the user equipment, the audio content by using a process ofthe 3D application, and displaying the video content on the virtualscreen by using the process of the 3D application.

In these example embodiments of this application, the audio data and thevideo data are rendered by using the web page process, and then aredisplayed by using the process of the 3D application, so that a pagerendered by the web page process is extracted by cross-processcommunication when web page rendering data is required for the processof the 3D application. The process of the 3D application and the webpage process can be separated by such processing, increasing stabilityof the process of the 3D application.

Further, the video image data includes a plurality of image frames, andthe rendering the video data by using the web page process to obtain thevideo content includes:

determining differential content between an (N+1)th image frame and anNth image frame when the user equipment renders the (N+1)th image frameby using the web page process, and rendering only the differentialcontent when rendering the (N+1)th image frame, where N is an integergreater than 0.

In these example embodiments of this application, during image framerendering, repeated content is no longer rendered again, and onlydifferential content between two consecutive frames is rendered,reducing bandwidth consumption of a graphic processing unit (GPU), andimproving program execution efficiency and user experience.

Further, before the displaying the video content on the virtual screenby using the process of the 3D application, the method further includes:

performing, by the user equipment, inverse gamma correction on textureof the video content once; and

the displaying the video content on the virtual screen by using theprocess of the 3D application includes:

displaying, by the user equipment on the virtual screen by using theprocess of the 3D application, video content on which inverse gammacorrection has been performed.

In these example embodiments, used maps are maps on which gammacorrection has been performed, and if the gamma correction is notperformed, an operation result may be incorrect. In this case, imagedata submitted from another thread has been corrected, and a color castmay occur if the image data is directly put in a high-end renderingpipeline. Therefore, inverse gamma correction is performed on thetexture of the video content once.

Further, before the playing, by the user equipment, the audio content byusing a process of the 3D application, the method further includes:

introducing, by the user equipment, the audio content into a coordinatesystem of an interactive application to which the simulated objectbelongs, and determining audio intensity of the audio content atdifferent coordinate points; and

the playing, by the user equipment, the audio content by using a processof the 3D application includes:

playing, by the user equipment at the different coordinate points, theaudio content according to the audio intensity corresponding to thecoordinate points.

Audio playing intensity of different coordinate points is different;therefore, audio is introduced to the coordinate system, to produce astereophonic effect.

Further, for the obtaining, by the user equipment, audio and video datafrom the content providing server according to the content sourceaddress, the method further includes:

obtaining, by the user equipment, content of interaction between ananchor of the video content played on the virtual screen and thesimulated object; and

for the displaying the video content by using the virtual screen, themethod further includes:

displaying, by the user equipment, the interaction content by using thevirtual screen.

The content of interaction between the anchor and the simulated objectmay be displayed by using the virtual screen, increasing interactionbetween a user and the anchor.

Further, the method further includes:

displaying, at a position of the simulated object, content ofinteraction between the simulated object and another simulated object.

In a relatively real recreational zone, players in the 3D applicationhave respective game roles. The roles may talk with each other, and makeexemplary actions. Players in a same recreational zone may watch thesame content, and have a same topic. As shown in FIG. 3B, aconversation, “what would you like to drink?”, that is made by asimulated object with another simulated object may be displayed nearbythe simulated object.

A 3D application scenario is broadcasting live game content on a largescreen by a game anchor when playing a game. For such a scenario relatedto an anchor, FIG. 4 is described below.

FIG. 4 is a schematic diagram of another example of a 3D applicationsystem according to example embodiments.

As shown in FIG. 4, the 3D application system further includes userequipment used by an anchor. The anchor broadcasts a live game by usingthe user equipment, and a live game video stream is uploaded to acontent providing server. The anchor has registered with a game serverin advance; therefore, the game server stores a source address of livecontent that is currently broadcasted. A player may further interactwith the anchor. Therefore, a live broadcasting procedure may furtherinclude content of interaction between the anchor and a simulatedobject. Therefore, user equipment may obtain the live video stream andthe interaction content from the content providing server.

The user equipment renders audio and a video after obtaining the livevideo stream and the interaction content, to obtain corresponding audiocontent and video content, and plays the audio content by using a 3Dapplication and displays the video content and the interaction contentby using the virtual screen.

The following describes, with reference to FIG. 5, a content presentingmethod in a scenario including an anchor that performs livebroadcasting.

FIG. 5 is a schematic diagram of an example embodiment of a contentpresenting method according to example embodiments.

201. An anchor broadcasts a live video on the Internet, and the anchorsubmits, to a content providing server by using user equipment, a livevideo stream broadcasted by the anchor.

202. After a user opens a 3D application program on a corresponding userequipment, the program starts to initialize a 3D rendering engine in a3D application.

203. The program starts to automatically request a video source addressof the anchor currently performing live broadcasting.

204. A 3D application server delivers the video source address to anaudio and video rendering module of the corresponding user equipment.

205. The audio and video rendering module requests a data stream of thelive video from the content providing server.

206. A live video server returns a video data stream to the audio andvideo rendering module.

207. The audio and video rendering module renders audio by using audioand video data.

208. The audio and video rendering module submits audio data to an audioengine in the 3D application.

209. The audio and video rendering module renders a video single-frameimage by using the audio and video data.

210. The audio and video rendering module submits image data to the 3Drendering engine in the 3D application.

211. The rendering engine performs rendering in a 3D world by usingrendered static frame data, plays audio content, and presents a videopicture to the user.

For an image rendering procedure of step 209, it may be understood thatbecause a flash technology frame is generally used for a live video onthe Internet, and a used flash plug-in has a plurality of uncertainissues, another independent process is used in this application forrendering a web page, to prevent the flash plug-in from affectingstability of a game. The game may only need to extract a web page to berendered by cross-process communication when web page rendering data isrequired. A game process and a web page rendering process can beseparated by such processing, increasing stability of the game process.

For a cross-process image rendering procedure, refer to FIG. 6 forunderstanding.

FIG. 6 is a schematic diagram of cross-process image rendering accordingto example embodiments.

The cross-process image rendering process is divided into two processes:a game rendering process and a web page rendering process. A renderingprocedure of the two processes may be performed by the user equipment,and include the following steps:

20911. Perform a game rendering process.

20921. Perform a web page rendering process.

20922. Initialize rendering.

20912. Enter a main loop of a game.

20913. Start rendering.

20914. Render game content.

20915. Check whether Internet video stream rendering exists; and performstep 20923 if an Internet video stream rendering exists, or perform step20917 if no Internet video stream rendering exists.

20923. Wait for a game process rendering message.

20924. Detect whether a dirty page currently exists; and perform steps20925 and 20926 if a dirty page currently exists, or perform step 20927if no dirty page exists currently.

Checking a dirty page means checking whether there is a contentdifference between two image frames, and differential content is a dirtypage if there is a content difference between the two image frames.

20925. Update the dirty page.

20926. Format an updated page into a format available for the game.

For a procedure of updating a dirty region, refer to FIG. 7 forunderstanding.

FIG. 7 is a schematic diagram of dirty region update according toexample embodiments.

A dirty region of a web page image buffer in a central processing unit(CPU) is updated, to obtain a dirty region in video random access memory(RAM) texture in an image processing unit or graphics processing unit(GPU).

Referring again to FIG. 6, the rendering procedure of the two processesmay include the following steps:

20927. Directly return if no dirty page exists.

20928. Complete web page rendering.

20916. Combine game content and web page content.

20917: Complete the rendering.

The main loop of the game may be entered again, to repeat the loop.

The method for updating a dirty region may reduce bandwidth consumptionof a GPU, and improve program execution efficiency and user experience.

Image data of Internet video rendering can be obtained after theforegoing steps are performed, but the data cannot be directly used infinal rendering. The following focuses on the description of step 211.

A modern graphics engine tends to have a plurality of renderingpipelines, to satisfy different image quantity requirements.

FIG. 8 is a schematic diagram of an example of a web page according toexample embodiments. FIG. 9 is a schematic diagram of an example of aweb page with an added virtual screen according to example embodiments.FIG. 10 is a schematic diagram of an example of a web page with an addedvirtual screen after inverse gamma correction according to exampleembodiments.

For example, in a high-end rendering pipeline, used maps are maps onwhich gamma correction has been performed, as shown in FIG. 8. If thegamma correction is not performed, an operation result may be incorrect.In this case, image data submitted from another web page process andobtained in the game process is image data on which gamma correction hasbeen performed, and a color cast may occur if the image data is directlyput in the high-end rendering pipeline. For example, as shown in FIG. 9,a color of a picture in FIG. 9 is obviously darker than a color of apicture in FIG. 8, and a color cast occurs.

A browser component obtains, by rendering, a texture on which gammacorrection has been performed once, and may need to perform inversegamma correction once first to obtain linear color space. Then, apicture without a color cast shown in FIG. 10 can be obtained.

For compatibility issues of high-end, middle-end, low-end machines,because a broadcasting screen does not need to be exposed to light, aninverse gamma correction may only need to be performed once, resultingin relatively low rendering consumption. Therefore, the foregoingprocessing procedure can be used for all of the high-end, middle-end,low-end machines.

A procedure of presenting a video image in a 3D application is completedafter the foregoing steps are performed, the following describes outputand processing of audio information, that is, focuses on the descriptionof step 207.

FIG. 11 is a schematic diagram cross-process audio rendering accordingto example embodiments.

The cross-process audio rendering may be performed by the userequipment, and may include the following steps:

20711. Perform a game rendering process.

20721. Perform a web page rendering process.

20712. Enter a main loop of a game.

20722. Initialize a web page sound interface.

20713. Prepare sound content of the game.

20714. Check whether a web page sound requirement exists; and performstep 20723 if a web page sound requirement exists, or perform step 20716if no web page sound requirement exists.

20723. Wait for a game process to read sound data.

20724. Extract a current sound data stream.

20725. Convert a format of the data stream into audio data.

20726. The web page rendering process ends.

20715. Put a web page sound source into a 3D coordinate system.

20716. Perform sound synthesis.

The main loop of the game may be entered again, to repeat the loop.

After step 20716, the game may end.

By analyzing a sound interface of a web page rendering engine, thisapplication configures a sound interface applicable to systems such asXP and win7. A data steam may be exported by using the interface, andthe obtained data stream may be configured into a 3D coordinate systemof a 3D game. In this way, a simulated object of a player may perceivedifferent audio intensity when the simulated object stands at differentpositions in the game. By the foregoing method, a stereophonic soundeffect is implemented.

This application implements a function of playing an Internet videostream in a 3D game, and combines a recreation game with an Internetvideo, so that a player can watch a favored video program while playinga game, resolving a problem of frequently switching between a browserand the game for the player, and providing intuitive experience in whichplayers watch a competition together, thereby greatly improving gameexperience of the player.

FIG. 12 is a schematic diagram of user equipment according to exampleembodiments.

Referring to FIG. 12, user equipment 30 is applicable to a 3Dapplication system. The 3D application system further includes a 3Dapplication server and a content providing server. The user equipment 30includes:

a response unit 301, configured to start a 3D application in response toan instruction for starting the 3D application, the 3D applicationincluding a simulated object and a virtual screen for watching videocontent by the simulated object;

a receiving unit 302, configured to: receive a content source addresssent by the 3D application server, after the response unit 301 startsthe 3D application, the content source address being an address of livecontent that is currently broadcasted on the 3D application server;

an obtaining unit 303, configured to obtain audio and video data fromthe content providing server according to the content source addressreceived by the receiving unit 302;

a rendering unit 304, configured to render the audio and video dataobtained by the obtaining unit 303, to obtain video content and audiocontent;

a playing unit 305, configured to play, in the 3D application, the audiocontent obtained by the rendering unit 304 by rendering; and

a display unit 306, configured to display, by using the virtual screen,the video content obtained by the rendering unit 304 by rendering.

In these example embodiments of this application, the response unit 301starts a 3D application in response to an instruction for starting the3D application, the 3D application including a simulated object and avirtual screen for watching video content by the simulated object. Thereceiving unit 302 receives a content source address sent by the 3Dapplication server, after the response unit 301 starts the 3Dapplication, the content source address being an address of live contentthat is currently broadcasted on the 3D application server. Theobtaining unit 303 obtains audio and video data from the contentproviding server according to the content source address received by thereceiving unit 302. The rendering unit 304 renders the audio and videodata obtained by the obtaining unit 303, to obtain video content andaudio content. The playing unit 305 plays, by using the 3D application,the audio content obtained by the rendering unit 304 by rendering. Thedisplay unit 306 displays, by using the virtual screen, the videocontent obtained by the rendering unit 304 by rendering. A small windowmay need to be used to display other video content when a 3D applicationis displayed. By comparison, the user equipment provided in theseexample embodiments of this application can present video content on avirtual screen of a 3D application without additionally opening a smallwindow by a user, improving video content presentation quality, and alsoimproving efficiency of communication between the user and aninteractive application and the video content.

Optionally, based on the example embodiments corresponding to FIG. 12,in a first optional example embodiment of the user equipment:

the rendering unit 304 is configured to: when the audio and video dataincludes audio data and video data, render the audio data by using a webpage process to obtain the audio content, and render the video data byusing the web page process to obtain the video content;

the playing unit 305 is configured to play the audio content by using aprocess of the 3D application; and

the display unit 306 is configured to display the video content on thevirtual screen by using the process of the 3D application.

Optionally, based on the first optional example embodiment of the userequipment, in a second optional example embodiment of the userequipment:

the rendering unit 304 is configured to: determine, when the video imagedata includes a plurality of image frames, differential content betweenan (N+1)th image frame and an Nth image frame when the user equipmentrenders the (N+1)th image frame by using the web page process, andrender only the differential content when rendering the (N+1)th imageframe, where N is an integer greater than 0.

FIG. 13 is a schematic diagram of another example of user equipmentaccording to example embodiments.

Optionally, based on the first optional example embodiment of the userequipment, referring to FIG. 13, in a third optional example embodimentof the user equipment, the user equipment further includes a correctionunit;

the correction unit 307 is configured to perform inverse gammacorrection on texture of the video content once before the display unit306 displays the video content; and

the display unit 306 is configured to display, on the virtual screen byusing the process of the 3D application, video content on which thecorrection unit 307 has performed inverse gamma correction.

FIG. 14 is a schematic diagram of another example of user equipmentaccording to example embodiments.

Optionally, based on any one of the first optional example embodiment tothe third optional example embodiment of the user equipment, referringto FIG. 14, in a fourth optional example embodiment of the userequipment, the user equipment further includes a determining unit 308;

the determining unit 308 is configured to: introduce the audio contentinto a coordinate system of an interactive application to which thesimulated object belongs, and determine audio intensity of the audiocontent at different coordinate points; and

the playing unit 305 is configured to play, at the different coordinatepoints, the audio content according to the audio intensity correspondingto the coordinate points that is determined by the determining unit 308.

Optionally, based on any one of the example embodiments corresponding toFIG. 12, and the first optional example embodiment to the third optionalexample embodiment of the user equipment, in a fifth optional exampleembodiment of the user equipment:

the obtaining unit 303 is further configured to obtain content ofinteraction between an anchor of the video content played on the virtualscreen and the simulated object; and

the display unit 306 is further configured to display the interactioncontent by using the virtual screen.

Optionally, based on any one of the example embodiments corresponding toFIG. 12, and the first optional example embodiment to the third optionalexample embodiment of the user equipment, in a sixth optional exampleembodiment of the user equipment:

the display unit 306 is further configured to display, at a position ofthe simulated object, content of interaction between the simulatedobject and another simulated object.

For the user equipment 30, refer to related descriptions in FIG. 1 toFIG. 11 for understanding, and details are not described herein.

FIG. 15 is a schematic structural diagram of the user equipment 30according to example embodiments. The user equipment 30 is applied to a3D application system, and the 3D application system includes the userequipment, a 3D application server, and a content providing server. Theuser equipment 30 includes a CPU 3101, a GPU 3102, a transceiver 340, amemory 350, and an input/output (I/O) device 330. The input/outputdevice 330 may be a keyboard or a mouse, and the GPU 3102 is configuredto render a graph. The memory 350 may include a read-only memory (ROM)and a RAM, and provide operation instructions and data to a processor310. A part of the memory 350 may further include a non-volatile randomaccess memory (NVRAM).

In some implementations, the memory 350 stores the following elements:an executable module or a data structure, or a subset thereof, or anextension set thereof.

In these example embodiments of this application, by invoking theoperation instructions (the operation instructions may be stored in anoperating system) stored in the memory 350:

the input/output device 330 is configured to receive an instruction forstarting a 3D application;

the CPU 3101 is configured to start the 3D application in response tothe instruction for starting the 3D application, the 3D applicationincluding a simulated object and a virtual screen for watching videocontent by the simulated object;

the transceiver 340 is configured to receive a content source addresssent by the 3D application server, the content source address being anaddress of live content that is currently broadcasted on the 3Dapplication server;

the CPU 3101 is configured to obtain audio and video data from thecontent providing server according to the content source address;

the GPU 3102 is configured to render the audio and video data to obtainvideo content and audio content; and

the input/output device 330 is configured to play the audio content inthe 3D application, and display the video content by using the virtualscreen.

A small window may need to be used to display other video content when a3D application is displayed. By comparison, the user equipment providedin these example embodiments of this application can present videocontent on a virtual screen of a 3D application without additionallyopening a small window by a user, improving video content presentationquality, and also improving efficiency of communication between the userand an interactive application and the video content.

The CPU 3101 controls an operation of the user equipment 30. The memory350 may include a ROM and a RAM, and provide instructions and data tothe CPU 3101. A part of the memory 350 may further include a NVRAM. Inan application, all components of the user equipment 30 are coupled byusing a bus system 320, and besides a data bus, the bus system 320 mayfurther include a power source bus, a control bus, a state signal bus,and the like. However, for purpose of clear description, various typesof buses in the figure are all marked as the bus system 320.

The methods disclosed in the foregoing example embodiments of thisapplication are applicable to the processor 310, or may be implementedby the processor 310. The processor 310 may be an integrated circuitchip and have a signal processing capability. During implementation,each step of the foregoing methods may be implemented by a hardwareintegrated logic circuit in the processor 310 or by an instruction in asoftware form. The processor 310 may be a general-purpose processor, adigital signal processor (DSP), an application-specific integratedcircuit (ASIC), a field programmable gate array (FPGA), or anotherprogrammable logic device, discrete gate or transistor logic device, ordiscrete hardware component. The processor 310 may implement or executethe methods, steps, and logical block diagrams disclosed in the exampleembodiments of this application. The general-purpose processor may be amicroprocessor or the processor may be any conventional processor or thelike. The steps of the methods disclosed with reference to the exampleembodiments of this application may be directly executed and completedby a hardware decoding processor, or may be executed and completed byusing a combination of hardware and software modules in the decodingprocessor. The software module may be located in a mature storage mediumin the field, such as a RAM, a flash memory, a ROM, a programmableread-only memory, an electrically-erasable programmable memory, or aregister. The storage medium is located in the memory 350, and theprocessor 310 reads information in the memory 350 and completes thesteps in the foregoing methods in combination with hardware of theprocessor 350.

Optionally, the GPU 3102 is configured to render the audio data by usinga web page process to obtain the audio content, and render the videodata by using the web page process to obtain the video content; and theinput/output device 330 is configured to play the audio content by usinga process of the 3D application, and display the video content on thevirtual screen by using the process of the 3D application.

Optionally, the GPU 3102 is configured to determine differential contentbetween an (N+1)th image frame and an Nth image frame when the userequipment renders the (N+1)th image frame by using the web page process,and render only the differential content when rendering the (N+1)thimage frame, where N is an integer greater than 0.

Optionally, the CPU 3101 is configured to perform, by the userequipment, inverse gamma correction on texture of the video contentonce; and the input/output device 330 is configured to display, on thevirtual screen by using the process of the 3D application, video contenton which inverse gamma correction has been performed.

Optionally, the CPU 3101 is configured to introduce the audio contentinto a coordinate system of an interactive application to which thesimulated object belongs, and determine audio intensity of the audiocontent at different coordinate points; and the input/output device 330is configured to play, at the different coordinate points, the audiocontent according to the audio intensity corresponding to the coordinatepoints.

Optionally, the CPU 3101 is configured to obtain content of interactionbetween an anchor of the video content played on the virtual screen andthe simulated object; and the input/output device 330 is configured todisplay the interaction content by using the virtual screen.

Optionally, the input/output device 330 is configured to display, at aposition of the simulated object, content of interaction between thesimulated object and another simulated object.

For the user equipment 30, refer to related descriptions in FIG. 1 toFIG. 11 for understanding, and details are not described herein.

A person of ordinary skill in the art may understand that all or some ofthe steps of the methods in the example embodiments may be implementedby a program instructing relevant hardware. The program may be stored ina computer readable storage medium. The storage medium may include: aROM, a RAM, a magnetic disk, or an optical disc.

As is traditional in the field of the inventive concepts, the exampleembodiments are described, and illustrated in the drawings, in terms offunctional blocks, units and/or modules. Those skilled in the art willappreciate that these blocks, units and/or modules are physicallyimplemented by electronic (or optical) circuits such as logic circuits,discrete components, microprocessors, hard-wired circuits, memoryelements, wiring connections, and the like, which may be formed usingsemiconductor-based fabrication techniques or other manufacturingtechnologies. In the case of the blocks, units and/or modules beingimplemented by microprocessors or similar, they may be programmed usingsoftware (e.g., microcode) to perform various functions discussed hereinand may optionally be driven by firmware and/or software. Alternatively,each block, unit and/or module may be implemented by dedicated hardware,or as a combination of dedicated hardware to perform some functions anda processor (e.g., one or more programmed microprocessors and associatedcircuitry) to perform other functions. Also, each block, unit and/ormodule of the example embodiments may be physically separated into twoor more interacting and discrete blocks, units and/or modules withoutdeparting from the scope of the inventive concepts. Further, the blocks,units and/or modules of the example embodiments may be physicallycombined into more complex blocks, units and/or modules withoutdeparting from the scope of the inventive concepts.

The content presenting method, the user equipment, and the systemprovided in the example embodiments of this application are described indetail above. Principles and implementations of this application havebeen explained herein with reference to the example embodiments. Theexample embodiments are used only to help understand the method and corethought of this application. A person of ordinary skill in the art canhave variations in implementations and the application scope based onthoughts of this application. In conclusion, content of the presentspecification may not be considered as a limitation on this application.

What is claimed is:
 1. A content presenting method of athree-dimensional (3D) application system, the 3D application systemcomprising user equipment of an end user, a 3D application server, and acontent providing server, and the method comprising: starting, by theuser equipment, a 3D application, in response to an instruction, the 3Dapplication presenting a simulated object of the end user and a virtualscreen for displaying live content in a virtual environment; receiving,by the user equipment, a content source address of the live content thatis provided by another user equipment of an anchor to the contentproviding server, and that is currently broadcasted on the contentproviding server; obtaining, by the user equipment, audio data and videodata of the live content from the content providing server, based on thecontent source address; rendering, by the user equipment, the audio dataand the video data to obtain video content and audio content;introducing, by the user equipment, the audio content into a 3Dcoordinate system of the 3D application system; determining, by the userequipment, at different 3D coordinate points of the 3D coordinatesystem, audio intensities of the audio content for the simulated objectin relation to location of the virtual screen and location of thesimulated object; playing, by the user equipment, the audio content inthe 3D application system, using the audio intensities for the simulatedobject; obtaining, by the user equipment, content of interaction betweenthe anchor of the video content displayed using the virtual screen andthe simulated object; and displaying, by the user equipment, the videocontent and the content of interaction on the virtual screen.
 2. Themethod according to claim 1, wherein the rendering the audio data andthe video data comprises: rendering, by the user equipment, the audiodata, using a web page process, obtain the audio content, the web pageprocess being independent of the 3D application; and rendering, by theuser equipment, the video data, using the web page process to obtain thevideo content.
 3. The method according to claim 2, wherein the videodata comprises a plurality of image frames, and the rendering the videodata, using the web page process, comprises rendering, by the userequipment, an (N+1)th image frame among the plurality of image frames,using the web page process, N being an integer greater than 0, by:determining, by the user equipment, differential content between an(N+1)th image frame and an Nth image frame among the plurality of imageframes; and rendering, by the user equipment, the differential content.4. The method according to claim 1, further comprising, before thedisplaying the video content, performing, by the user equipment, inversegamma correction on texture of the video content, wherein the displayingthe video content comprises displaying, by the user equipment, on thevirtual screen, the texture of the video content on which the inversegamma correction is performed.
 5. The method according to claim 1,wherein the live content is a live game video broadcasted by the anotheruser equipment of the anchor.
 6. The method according to claim 1,further comprising displaying, by the user equipment, at a position ofthe simulated object, another content of interaction between thesimulated object and another simulated object.
 7. User equipment of anend user of a three-dimensional (3D) application system, the 3Dapplication system further comprising a 3D application server and acontent providing server, and the user equipment comprising: at leastone memory configured to store computer program code; and at least oneprocessor configured to access the at least one memory and operateaccording to the computer program code, the computer program codecomprising: response code configured to cause the at least one processorto start a 3D application, in response to an instruction, the 3Dapplication presenting a simulated object of the end user and a virtualscreen for displaying live content in a virtual environment; receivingcode configured to cause the at least one processor to receive a contentsource address of the live content that is provided by another userequipment of an anchor to the content providing server, and that iscurrently broadcasted on the content providing server; obtaining codeconfigured to cause the at least one processor to obtain audio data andvideo data of the live content from the content providing server, basedon the content source address, and to obtain content of interactionbetween the anchor of the video content displayed using the virtualscreen and the simulated object; rendering code configured to cause theat least one processor to render the audio data and the video data toobtain video content and audio content; introducing code configured tocause the at least one processor to introduce the audio content into a3D coordinate system of the 3D application system; determining codeconfigured to cause the at least one processor to determine, atdifferent 3D coordinate points of the 3D coordinate system, audiointensities of the audio content for the simulated object in relation tolocation of the virtual screen and location of the simulated object;playing code configured to cause the at least one processor to play theaudio content in the 3D application system, using the determined audiointensities for the simulated object; and displaying code configured tocause the at least one processor to display the video content and thecontent of interaction on the virtual screen.
 8. The user equipmentaccording to claim 7, wherein the rendering code is further configuredto cause the at least one processor to: render the audio data, using aweb page process, obtain the audio content, the web page process beingindependent of the 3D application; and render the video data, using theweb page process to obtain the video content.
 9. The user equipmentaccording to claim 8, wherein the video data comprises a plurality ofimage frames, and the rendering code is further configured to cause theat least one processor to render an (N+1)th image frame among theplurality of image frames, using the web page process, N being aninteger greater than 0, by: determining differential content between an(N+1)th image frame and an Nth image frame among the plurality of imageframes; and rendering the differential content.
 10. The user equipmentaccording to claim 7, further comprising correcting code configured tocause the at least one processor to, before the video content isdisplayed, perform inverse gamma correction on texture of the videocontent, wherein the displaying code is further configured to cause theat least one processor to display, on the virtual screen, the texture ofthe video content on which the inverse gamma correction is performed.11. The user equipment according to claim 7, wherein the displaying codeis further configured to cause the at least one processor to display, ata position of the simulated object, another content of interactionbetween the simulated object and another simulated object.
 12. Anon-transitory computer-readable storage medium storing instructionsthat cause a processor of user equipment of an end user to: start a 3Dapplication, in response to an instruction, the 3D applicationpresenting a simulated object of the end user and a virtual screen fordisplaying live content in a virtual environment; receive a contentsource address of the live content that is provided by another userequipment of an anchor to the content providing server, and that iscurrently broadcasted on content providing server; obtain audio data andvideo data of the live content from the content providing server, basedon the content source address; render the audio data and the video datato obtain video content and audio content; introduce the audio contentinto a 3D coordinate system of the 3D application system; determine atdifferent 3D coordinate points of the 3D coordinate system, audiointensities of the audio content for the simulated object in relation tolocation of the virtual screen and location of the simulated object;play the audio content in the 3D application system, using thedetermined audio intensities for the simulated object; obtain content ofinteraction between the anchor of the video content displayed using thevirtual screen and the simulated object; and display the video contentand the content of interaction on the virtual screen.
 13. Thenon-transitory computer-readable storage medium according to claim 12,wherein the instructions further cause the processor to: render theaudio data, using a web page process, obtain the audio content, the webpage process being independent of the 3D application; and render thevideo data, using the web page process to obtain the video content. 14.The non-transitory computer-readable storage medium according to claim13, wherein the video data comprises a plurality of image frames, andthe instructions further cause the processor to render an (N+1)th imageframe among the plurality of image frames, using the web page process, Nbeing an integer greater than 0, by: determining, by the user equipment,differential content between an (N+1)th image frame and an Nth imageframe among the plurality of image frames; and rendering, by the userequipment, the differential content.
 15. The non-transitorycomputer-readable storage medium according to claim 12, wherein theinstructions further cause the processor to: before the displaying thevideo content, perform inverse gamma correction on texture of the videocontent; and display on the virtual screen, the texture of the videocontent on which the inverse gamma correction is performed.